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SDFSS  Opportunities 


Impacts  without  SDFSS 

•  Multi-year  development 
projects  failed  to  deliver  a 
working  product  (min  cost=$7M) 

•  Failure  1:  Did  not  model 
performance  of  new  chipset, 
processor  or  language 

•  Failure  2:  Did  not  adequately 
characterize  the  market  and 
business  case 

•  Failure  3:  Did  not  adequately 
test  the  product 


Benefits  with  SDFSS 

•  Business  cases  modeling  all 
reasonable  uncertainties  in 
market  and  customer  segments 

•  Schedules  with  uncertainties 
modeled 

•  Req’ts  identified,  with  KJ 
analysis,  to  delight  customers 

•  Design  of  Experiments  used 
to:  optimize  and  patent  fuel 
efficiency;  test  object-oriented 
software;  test  robustness  with 
fault  insertion  testing;  reduce 
flight  test  by  lOx 
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Purpose  of  this  Talk 


•  To  proclaim  that  software  DFSS,  within  a  holistic  DFSS 
approach  to  product  development,  is  coming  of  age, 

•  To  demonstrate  that  many  gaps,  in  translating  traditional 
DFSS  concepts  to  software  engineering,  may  be  solved  by 
the  adoption  of  a  number  of  Software  Engineering  Institute 
(SEI)  technologies. 

Thus,  DFSS  does  not  have  to  be  re-invented  for 

Software  Engineering! 
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Target  Audience 


•  Executives  and  Directors  contemplating  investing  in 
Software  DFSS 

•  Deployment  champions  who  may  be  tasked  with  the 
training  and  roll-out  of  Software  DFSS 

•  DFSS  and  Software  Engineering  Leaders  who  need  to 
understand  both  disciplines,  and  who  can  lead  in 
translating  and  interpreting  key  concepts  and  tools 
between  the  two  disciplines. 
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A  Philosophy 

From  the  inception  of  Six  Sigma,  the  overriding  objective 
has  been  “the  degree  of  confidence  a  customer  has  that 
his  (or  her)  product  and  service-related  expectations  will 
be  met  by  the  producer.”1 

Today,  it  is  “a  business  process  that  allows  companies  to 
drastically  improve  their  bottom  line  by  designing  and 
monitoring  everyday  business  activities  in  ways  that 
minimize  waste  and  resources  while  increasing  customer 
satisfaction.”2 

1  Michael  J.  Harry  &  J.  Ronald  Lawson,  “Six  Sigma  Producibility  Analysis  and  Process 
Characterization,"  Addison-Wesley  Publishing  Company,  Inc.,  1992. 

2  Michael  J.  Harry,  &  Richard  Schroeder,  “Six  Sigma:  The  Breakthrough  Management  Strategy 
Revolutionizing  the  World’s  Top  Corporations”,  2000. 
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Example  Six  Sigma  Measures 

The  most-cited  measure  is  “3.4  ppm.” 

Other  measures 

•  defect  rate,  parts  per  million  (ppm) 

•  Sigma  level 

•  defects  per  unit  (dpu) 
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Alternative  Six  Sigma  Approaches 


DMAIC 

Define-Measure- 

Analyze-lmprove- 

Control 

To  solve  problems  and  drive  incremental 
business  improvements  (e.g.  fine-tuning 
an  existing  process  or  product) 

DMAD(0)V 

Define-Measure- 

Analyze-Design- 

(Optimize)-Verify 

To  solve  problems  and  drive  radical 
improvement  (e.g.  blowing  up  and  re¬ 
engineering  an  existing  process  or 
product) 

Lean 

5S’s;  Value  Stream 
Mapping;  Cycle 

Time  Analysis 

To  lean  a  process  by  simplification, 
reducing  non-value  added  tasks, 
optimizing  cycle  times 

DFSS 

Design-For-Six- 

Sigma 

Applying  the  Six  Sigma  toolkit  and  intent 
to  product  development  beginning  with 
portfolio,  marketing,  engineering, 
research,  sales,  and  supply  chain 
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Holistic  View  of  Software  DFSS 


Portfolio  for  Six  Sigma 


Marketing  for  Six  Sigma 


Product  Commercialization  for  Six  Sigma 


Technology  Platform  R&D  for  Six  Sigma 


Sales  &  Distribution  for  Six  Sigma 


Supply  Chain  for  Six  Sigma 
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Holistic  View  of  Software  DFSS 


Portfolio  for  Six  Sigma 


*  Adapted  from  Clyde  Creveling,  Marketing  for  ‘ 
Sigma  and  Product  Development  with  Six  Sign 


1 .  Identify  Opportunities,  Markets  and  Market  Segments, 

2.  Gather  Long  Range  Voice  of  the  Customer, 

3.  Obtain  Technology  Roadmap  and  Technology  Characterizations  from  the 
R&D  /  Platform  Group, 

4.  Define  Product  Portfolio  Requirements, 

5.  Generate  Product  Portfolio  Architectures, 

6.  Support  Portfolio  decisions  with  Real-Options  analysis 

7.  Evaluate  and  Select  a  Product  Portfolio,  and 

Develop  a  Prioritized  List  of  Products  within  a  Product  Line  Strategy. 
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istic  View  of  Software  DFSS 


Portfolio  for  Six  Sigma 


Marketing  for  Six  Sigma 


Using  Statistical  Methods: 


*  Adapted  from  Clyde  Creveling,  Marketing  for  Six 
Sigma  and  Product  Development  with  Six  Sigma 


1. 

2. 

3. 

4. 

5. 

6. 
7. 


Understand  Customer  Value  and  create  a  Customer  Value  Dashboard, 
Develop  the  Value  Stream  analysis, 

Conducting  Marketing  FMEA  risk  analysis  and  Business  SWOT, 

Creating  Marketing  Process  measures  and  data  collection  methods, 

KJ  and  Kano  Analysis, 

Marketing  Composite  Design  and  Product  Line  Strategies 
Market  Forecasting,  Price  Model  Planning,  Channel  Analysis, 

Portfolio  Management,  Branding  Decision-making  and  Promotion  Analyst 
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Holistic  View  of  Software  DFSS 


Portfolio  for  Six  Sigma 


Marketing  for  Six  Sigma 


Product  Commercialization  for  Six  Sigma 


*  Adapted  from  Clyde  Creveling,  Marketing  for  Six 
Sigma  and  Product  Development  with  Six  Sigma 


1 .  Participate  in  KJ  and  QFD  Voice  of  the  Customer  Activities, 

2.  Develop  functional  models,  architecture  and  behavioral  models, 

3.  Generate  product  solution  concepts  and  identify  critical  parameters  for 
CTQs, 

4.  Develop  mathematical  and  statistical  models  of  CTQs, 

5.  Select  solution,  implement  robust  design  and  track  Critical  Parameters, 

6.  Create  optimized  designs  using  designed  experiments, 

Establish  critical  parameter  tolerances,  and  verify  CTQ  achievement. 
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Holistic  View  of  Software  DFSS 


Portfolio  for  Six  Sigma 

Marketing  for  Six  Sigma 

Product  Commercialization  for  Six  Sigma 
Technology  Platform  R&D  for  Six  Sigma 

Using  Statistical  Methods: 

Characterize  existing  technologies,  capabilities,  gaps,  risks,  expected  life 

Identify  and  evaluate  anticipated  technology  breakthroughs  including 
probabilistic  assessment  of  timing  and  capability 

Optimize  the  portfolio  of  technologies  to  be  pursued  in  context  of  the 
business  strategy  and  latest  product  portfolio 

Develop  robust  platforms  that  are  optimized  for  the  Customer  Req’ts  and 
CTQs  of  product  lines 

Develop  performance  models  of  platform  technology  and  it’s  capabilities 


1. 

2. 

3. 

4. 
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SEI  Technologies  Boost  DFSS! 


Portfolio  for  Six  Sigma 


Marketing  for  Six  Sigma 


Product  Commercializati 


/'The  SEI  Capability^ 
Maturity  Model 
Integrated  (CMMI) 

has  a  product 
development 
perspective  that 
overlaps 

significantly  with  all 
of  the  DFSS 


Technology  Platform  R&D  for  Six  methodologies! 


Sales  &  Distribution  for  Six  Sigma 


Supply  Chain  for  Six  Sigma 
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CMMI  &  Six  Sigma  (DFSS)  Connections 


•  Many  connections  exist,  specifically  with  the  following 
basic  process  areas: 

•  RD,  REQM,  TS 

•  VER,  VAL 

•  DAR,  RSKM,  MA 

•Connections  are  further  highlighted  on  the  following 
slides  with  CMMI  High  Maturity  Process  Areas: 

•  QPM,  OPP 

•  CAR,  01 D 
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CMMI  OPP  and  Six  Sigma 


SP1.1  Processes 


SP1 .2  Measures 


|  S  Big  Y  Business  Goal-to-Vital  x  Process; 

*  Processes  driving  central  tendency  and  variation 

I - k  Critical  Parameter  Management;  CTQ  factors;  Root 

- v  Cause  Analysis  of  subprocess  factors 


SP1.3  Objectives  ■=>  KJ  Analysis®;  Analytic  Hierarchy  Process;  Categorical 

Survey  Data  Analysis;  Six  Sigma  Scorecards 


SP1 .4  Baselines 


SP1 .5  Models 


■=> 

■=> 


Control  Charts;  Graphical  Summaries  in  Minitab;  Central 
Tendency  and  Variation;  Confidence  and  Prediction 
Intervals 

ANOVA;  Regression;  Chi-Square;  Logistic  Regression; 
Monte  Carlo  Simulation;  Discrete  Event  Process 
Simulation;  Design  of  Experiments;  Response  Surface 
Methodology;  Multiple  Y  Optimization;  Probabilistic 
Models 
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CMMI  QPM  and  Six  Sigma 


SGI 

Quantitatively 
Manage  the 
Project 


>=> 


KJ  Analysis®;  Analytic  Hierarchy  Process; 
Categorical  Survey  Data  Analysis;  Six  Sigma 
Scorecards;  Big  Y  Business  Goal-to-Vital  x 
Process;  Process  Mapping  Methods  and  Value- 
Stream  Analysis; 

Processes  driving  central  tendency  and  variation; 
Critical  Parameter  Management;  CTQ  factors;  Root 
Cause  Analysis  of  Sub-process  factors;  Cockpit 


SG2 

Statistically 

Manage 

Subprocess 

Performance 


Control  Charts;  Graphical  Summaries  in  Minitab; 
Central  Tendency  and  Variation;  Confidence  and 
Prediction  Intervals;  ANOVA;  Regression;  Chi- 
Square;  Logistic  Regression;  Monte  Carlo 
Simulation;  Discrete  Event  Process  Simulation; 
Design  of  Experiments;  Response  Surface 
Methodology;  Multiple  Y  Optimization;  Probabilistic 
Models 
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CMMI  CAR  and  Six  Sigma 


SP1.1  Select 
Defect  Data  for 
Analysis 


Measure  Phase  tools  and  methods  within  DMAIC 
or  DMAD(0)V;  Models  provide  insight  to  the  areas 
of  defect  data  to  concentrate  on 


SP1.2  Analyze 
Causes 

SP2.1  Implement 
the  Action 
Proposals 


■4 


Root  Cause  Methods,  e.g.  Ishikawa  Diagrams, 
statistical  hypothesis  tests  to  determine  if  segments 
are  different 

Piloting;  Comparative  Studies;  Technological  and 
Cultural  Change  Management  techniques 


SP2.2  Evaluate 
the  Effect  of 
Changes 


Before  and  After  studies  and  Hypothesis  tests; 
Survey  categorical  data  analysis;  compare  to 
results  of  prediction  models 


SP2.3  Record 
Data 


Study  results;  Lessons  Learned  shared  across  the 
organization;  Institutional  learning 
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CMMI  OID  and  Six  Sigma 


Six  Sigma  Big  Y  to  Vital  x  semi-annual  workshops; 
Business  Goal  simulation  and  optimization  models; 

SGI  Select  j - ^  Benchmarking;  Capability  data  sharing;  Theory  of 

Improvements  r  Inventing  (TRIZ)  methods;  Usage  of  performance 

models  to  identify  the  major  opportunities  for 
improvement  with  innovation;  Assumption  Busters; 
Empowered  innovative  thinking;  Incentives  for 
Innovation;  Strong  Teaming  for  Innovation; 

Various  decision  models  such  as  AHP,  Pugh 
Method,  Probabilistic  decision  trees 


SG2  Deploy  [-— K 
Improvements  * 


June  11-14,  2007 


Process  and  Design  FMEA;  Organizational 
Readiness  for  Change;  Change  Agents; 

Sponsors;  Champions;  Influence  Leaders; 
Adoption  Curve;  Piloting;  Risk-based  deployment; 
Before  and  After  comparisons  with  Hypothesis 
tests;  Results  compared  to  prediction  models; 
Proactive  mitigation  of  risks 
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The  CMMI,  TSP  and  PSP 


CMMI  -  for 
organizational 
capability 


TSP  -  for  quality 
products  on  cost 
and  schedule 


PSP  -  for 
individual  skill 
and  discipline 


ivuiuii  tiuiun  nuiuif 

III  ill  III 
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SEI  Technologies  Boost  DFSS! 


Portfolio  for  Six  Sigma 


Marketing  for  Six  Sigma 


The  SEI  Team  Software  Process  (TSP)  and 
Personal  Software  Process  (PSP)  significantly 
enhance  the  software  development  teaming 
within  Product  Commercialization  and 
Technology  Platform  R&D  for  Six  Sigma! 
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The  Personal  Software  Process 
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TSP  Builds  Software  Teams 


Skill- 

Team- 

Team- 

building 

building 

working 

Personal  plans 
Practice  in  planning 
Planning  methods 
Quality  measures 
Defined  processes 


ngmeermg 

Disciplines 


Reference:  “The' 
TSP  and  PSP 
Tutorial”  by  the  SEI 
(Burton,  Davis, 
McHale),  2000 


Aggressive  plans 
Quality  ownership 
Project  goals 
Plan  ownership 
Plan  detail 
Team  roles 
Team  resources 


Team 
Disciplines 


Integrated 
Product  Teams 


Quahty  priority 
Cost  of  quahty 
Follow  the  process 
Review  status 
Review  quality 
Communication 
Change  management 


Management 

Disciplines 
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The  TSP  Launch  Process 
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SEI  Technologies  Boost  DFSS! 


Portfolio  for  Six  Sigma 


The  SEI  Product  Line 
Practice  work  overlaps 
significantly  with  both 
Portfolio  for  Six  Sigma,  and 
Technology  Platform  R&D 

- -r - v  for  Six  Sigma! 

Product  flro  miners . . . 


Technology  Platform  R&D  for  Six  Sigma 


Sales  &  Distribution  for  Six  Sigma 


Supply  Chain  for  Six  Sigma 
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Software  Product  Lines 


Market  strategy/ 
Application  domain 


is  satisfied  by 


used  to  structure 


*  take  economic  advantage  of  commonality 

•  bound  variability 


□ 


CORE 

ASSETS 
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Product  Line  Practice  Framework 


Core  Asset 
Development 


Product 

Development 


Management 


Reference:  “Software 
Product  Lines”,  Paul 
Clements,  Linda  Northrop, 
2003. 


Architecture  Definition 
Architecture  Evaluation 
Component  Development 
COTS  Utilization 
Mining  Existing  Assets 
Requirements  Engineering 
Software  System  Integration 
Testing 

Understanding 
Relevant  Domains 


Software 

Engineering 


Essential  Activities 

Configuration  Management 
Data  Collection,  Metrics, 
and  Tracking 

Make/Buy/Mine/Commission 

Analysis 

Process  Definition 
Scoping 

Technical  Planning 
Technical  Risk  Management 
Tool  Support 


Technical 

Management 


Building  a  Business  Case 
Customer  Interface  Management 
Implementing  an  Acquisition 
Strategy 
Funding 

Launching  and  Institutionalizing 

Market  Analysis 

Operations 

Organizational  Planning 
Organizational  Risk  Management 
Structuring  the  Organization 
Technology  Forecasting 
Training 

Organizational 

Management 
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SEI  Technologies  Boost  DFSS! 
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Software  Architecture  Technology  (SAT) 
Initiative’s  Focus 

Ensure  that  business  and  mission  goals  are  predictably  achieved 
by  using  effective  software  architecture  practices  throughout  the 
development  lifecycle. 

Axioms  Guiding  Our  Work 

•  Software  architecture  is  the  bridge  between  business  and 
mission  goals  and  a  software-intensive  system. 

•  Quality  attribute  requirements  drive  software  architecture 
design. 

•  Software  architecture  drives  software  development  throughout 
the  life  cycle. 


Reference:  “Future  Directions  of  the  Software  Architecture  Technology 
Initiative”,  Second  Annual  SATURN  Workshop,  Mark  Klein,  2006 
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SEI’s  Architecture  Tradeoff  Analysis  Method® 
(ATAM®) 


ATAM  is  an  architecture  evaluation  method  that 

•  focuses  on  multiple  quality  attributes 

•  illuminates  points  in  the  architecture  where  quality  attribute 
tradeoffs  occur 

•  generates  a  context  for  ongoing  quantitative  analysis 

•  utilizes  an  architecture's  vested  stakeholders  as  authorities  on 
the  quality  attribute  goals 

Reference:  “Future  Directions  of  the  Software  Architecture  Technology 
Initiative”,  Second  Annual  SATURN  Workshop,  Mark  Klein,  2006 
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Conceptual  Flow  of  the  ATAMSM 


ftware 
cture 


impacts 


Quality 

Attributes 


Architectural 

Approaches 


Risk  Themes 


distilled 

into 


Tradeoffs 


Sensitivity  Points 


Non-Risks 


Risks 


Reference:  “Future  Directions  of  the  Software  Architecture  Technology  Initiative”,  SATURN  Workshop,  Mark  Klein,  2006 
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ATAM  Led  to  the  Development  of  Other 
Methods  and  Techniques 


What  if  the  quality 
requirements  are  not 
well-understood? 

Quality  Attribute 
Workshop 


What  if  there’s  no 
architecture? 

Attribute  Driven 


Our  scenarios  tend  to  be 
incomplete  or  ambiguous. 

Quality  Attribute  General  Scenarios 


What  if  I  don’t  know 
my  system’s 
^architecture? _ _ 

Architecture 
Reconstruction  using 
ARMIN 
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What  are  some  of 
the  most  important 
questions  to  ask? 


Quality  Attribute 
Tactics 


Which  risks  should  I  work  on 
first? 

Cost  Benefit  Analysis 
Method 


What  information  should  be 
included  in  my  architecture 
documentation? 


Views  and  Beyond 
Approach 
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In  Summary 

Software  DFSS,  within  a  holistic  DFSS  approach 
to  product  development,  is  coming  of  age, 

Many  gaps,  in  translating  traditional  DFSS 
concepts  to  software  engineering,  may  be 
solved  by  the  adoption  of  a  number  of  Software 
Engineering  Institute  (SEI)  technologies. 

Thus,  DFSS  does  not  have  to  be  re-invented  for 

Software  Engineering! 
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Contact  Information 

Robert  Stoddard 

Software  Engineering  Institute  (Office  3110) 
4500  Fifth  Avenue 
Pittsburgh,  PA  15213 

412.268.1121 

rws@sei.cmu.edu 


Or,  contact  SEI  Customer  Relations: 

Customer  Relations 
Software  Engineering  Institute 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213-3890 
FAX:  (412)268-5800 
customer-relations@sei.cmu.edu 
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Questions 
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